Observing, Coaching and Reflecting: A Multi-modal Natural Language-based Dialogue System in a Learning Context
نویسندگان
چکیده
The Metalogue project aims to develop a multi-modal, multi-party dialogue system with metacognitive abilities that will advance our understanding of natural conversational human-machine interaction and dialogue interfaces. This paper introduces the vision for the system and discusses its application in the context of debate skills training where it has the potential to provide learners with a rich, immersive experience. In particular, it considers a potentially powerful learning analytics tool in the form of a performance reflection dashboard.
منابع مشابه
Observing, Coaching and Reflecting: Metalogue - A Multi-modal Tutoring System with Metacognitive Abilities
The Metalogue project aims to develop a multi-modal, multi-party, dialogue system with metacognitive abilities that will advance our understanding of natural conversational human-machine interaction, and interfaces that incorporate multimodality into virtual and augmented reality environments. In this paper we describe the envisaged technical system, the learning contexts it is being developed ...
متن کاملMarkov Logic Networks for Spatial Language in Reference Resolution
This paper presents an approach for automatically learning reference resolution, which involves using natural language expressions, including spatial language descriptions, to refer to an object in a context. This is useful in conversational systems that need to understand the context of an utterance, like multi-modal or embodied dialogue systems. Markov Logic Networks are explored as a way of ...
متن کاملHuman-Machine Dialogue for Multi-Modal Decision Support Systems
In this paper we describe some of the research on multi-modal dialogue being performed in the Interactive Systems group at the Navy Center for Applied Research in Artificial Intelligence at the Naval Research Laboratory. Our concern with multi-modal interfaces arises from our past work in developing general-purpose natural language interfaces that can be applied to a variety of decision support...
متن کاملOn-Line Learning of a Persian Spoken Dialogue System Using Real Training Data
The first spoken dialogue system developed for the Persian language is introduced. This is a ticket reservation system with Persian ASR and NLU modules. The focus of the paper is on learning the dialogue management module. In this work, real on-line training data are used during the learning process. For on-line learning, the effect of the variations of discount factor (g) on the learning speed...
متن کاملOn-Line Learning of a Persian Spoken Dialogue System Using Real Training Data
The first spoken dialogue system developed for the Persian language is introduced. This is a ticket reservation system with Persian ASR and NLU modules. The focus of the paper is on learning the dialogue management module. In this work, real on-line training data are used during the learning process. For on-line learning, the effect of the variations of discount factor (g) on the learning speed...
متن کامل